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Abstract. Numerical observations on a Markov chain and on the continuous Markov 
process performed by a granular tracer show that the "usual" fluctuation relation for a 
given observable is not verified for finite (but arbitrarily large) times. This suggests that 
some terms which are usually expected to be negligible, i.e. "border terms" dependent 
only on initial and final states, in fact cannot be neglected. Furthermore, the Markov 
chain and the granular tracer behave in a quite similar fashion. 
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1. Introduction 

Non-equilibrium systems are at the center of old but still very lively research in physics, 
due to the great importance that out of equilibrium phenomena have in the natural 
world plEllHj. Since the seminal studies by Carnot, Clausius and Kelvin, who made clear 
the relevance of the lack of equilibrium in the extraction of work from heat, systems out 
of thermodynamic equilibrium are investigated in the vastest set of applications, ranging 
from mechanical engineering to the study of chemical reactions, molecular ratchets and 
all the biophysical processes of growth, differentiation, movement and evolution. 

On the theoretical side, the study of fluctuations in non-equilibrium systems 
has been marked by a series of fundamental breakthroughs, such as Einstein's 
work 13] on Brownian motion and the first statement of a Fluctuation-Response 
theory, through its celebrated relation between diffusivity and mobility; the Onsager's 
works on the reciprocity of transport coefficients and on the regression hypothesis 
of large fluctuations [Hj; and the works of Green and Kubo on the general linear 
response formalism and the Fluctuation-Dissipation relation (FDR) in its full dynamical 
form ini n\- All these works have resulted in the construction of the so-called Non- 
Equilibrium Thermodynamics [8 , that studies non-equilibrium states of smoothly 
varying locally equilibrated regions, i.e. of systems in local thermodynamic equilibrium. 

The FDR links the mean response to a perturbation with a suitable correlation 
function computed for the unperturbed system, and was originally developed in the 
context of (equilibrium) statistical mechanics of Hamiltonian systems. This fact 
was misunderstood by some authors. For instance, it was claimed (with qualitative 
arguments) that in fully developed turbulence (which is a non Hamiltonian and non 
equilibrium system) there is no relation between fluctuations and relaxation to the 
statistical steady state p^. In reality, a generahzed FDR holds under rather general 
hypothesis, independently from the Hamiltonian nature of the systems pTlj ITU IT^ . 
If the system is mixing and the invariant measure is "smooth" enough, there 
exists a connection between the "non equilibrium" properties (response to external 
perturbations) and the "equilibrium" properties (correlation functions computed 
according to the equilibrium measure of the unperturbed system). The validity of the 
FDR does not depend on the deterministic or stochastic nature of the system neither 
on the "equilibrium" or "non equilibrium" character of its statistical steady state. 

In the last decade a series of important results have been obtained, all related 
to a seemingly very general Fluctuation Relation (FR), that constrains without any 
fitting parameter the pdf of the fiuctuations of entropy production or, more generally, 
of dissipated energy. The main steps, in historical order, are: the proposal and the 
observation of FR in numerical simulations, by Evans, Cohen and Morris in 1993 a 
derivation of the same relation in transient states in 1994, by Evans and Searles and 
the derivation of a theorem for asymptotic states by Gallavotti and Cohen in 1995 |15j . 

If the chaotic hypothesis of the Gallavotti-Cohen theorem holds, the deterministic 
dynamics can be mapped onto a mixing Markovian stochastic process: this observation 
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stimulated the derivation of a stochastic version of the FR, first obtained by Lebowitz 
and Spohn JH] smd, more rigorously (and under more restrictive hypothesis) by 
Maes jT2|. The case of Langevin equations has been discussed by Kurchan |18j . 

In this paper we will work in the stochastic framework, where one can directly speak 
of the probability, 'Pr(^) say, of observing a given trajectory segment Q of temporal 
length r. To begin with, we restrict our discussion to the simpler case of discrete states 
and, therefore, discrete trajectories. Then, in the presence of an appropriate form of 
reversibility, for each trajectory Q one can define the quantity 

l^'(fi)=log^427, (1) 

where Q, is the reversal of Vt \. When detailed balance is satisfied one has W'{VL) = 0. 
In the following we will refer to such to "equilibrium". Equation (jT)) implies 

VriVt) = exp{W'{n))Vrm and, straightforwardly, 

prob(W^' = X)= J2 ^-(^) = Yl exp{W'{Q))Vrm = 

Q:W'{Q)=X Q:W'{n)=X 

exp(X) J2 ^-(^) = exp(X)prob(M/' = -X). (2) 

Q:W'{n)=-X 

The symmetry prob(iy = X) = exp(X)prob(iy = —X) is the simplest form of a FR. 
This relation is the basis of a variety of FR's discussed in the recent literature [T^ . 

In the treatment of Gallavotti and Cohen for deterministic systems, the time r 
must be large, the role of W is played by the time-integrated phase space contraction 
rate and the following large deviation function of W is considered: 

tt{x) = lim - log(prob(iy G {{x — 6)t, {x + 6)t) , for any 5 > .(3) 

T— >oo T 

The FR for W can then be written as 

X — 6 < n^x) — 7r(— x) < X + 6. (4) 

The idea underlying definition is to identify heuristically the contribution of 
a single trajectory to the entropy production, so that W physically represents an 
integrated flux (e.g. heat flux) divided by a temperature (or a sum of fluxes divided by 
the temperatures of the different reservoirs involved), i.e. W = (3EY where E is the 
applied non-conservative field, Y is its conjugated observable and E' x F is an energy. 
For small Gaussian fluctuations, the FR yields directly {W''^)c = {W''^)-{W'f = 2{W'), 
because of the parabolic shape of the large deviation function. Then the classical FDR 
emerges as a particular case near equilibrium (i.e. near (W) =0). In fact, the previous 
physical identification of W implies f3{Y'^)c = 2{Y)/E. Therefore, assuming that 
= 2Dt where D is given by its equilibrium value (as it is true to first order 
in E) and (Y) = mEt (linear response), one obtains m = (3D which is the celebrated 
Einstein relation between mobility m and diffusivity D. In a similarly straightforward 

I In section II the quantity denoted by W' will be contrasted with a different quantity denoted simply 
by W. 
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fashion, the Onsager reciprocal relations can be derived from the FR, recalling the time 
reversibility of the evolution. 

In deterministic dynamics, the Gallavotti-Cohen theorem is based on the hypothesis 
that the system is Anosov, hence that its phase space is bounded. In some systems 
(for example in presence of singular potentials) this hypothesis is not well controlled, 
because non-conservative forces let W fluctuate without bounds. In the stochastic 
framework, this problem can be cast into simple mathematical terms. In particular, 
Ref. [16J considers a Markov chain, in the stationary state, with probability of each 
trajectory Q given by 

= f,^,,Ul~,'K,^^^^, (5) 

where fiao is the invariant probability of the state a and Kcr^ai+i is the transition 
probability associated with the jump cTj o"j+i between two possible states of the 
chain. Therefore, the functional W can be divided in two pieces: 

W' = W + B (6) 

where B is logfio-o/f^a-r- this paper we will argue that the fluctuations of B, which 
has to be considered as a "border" term, are of practical importance (i.e. in numerical 
and, presumably, also in real experiments) in the measurements of W. The relevance of 
border terms for finite and infinite times has been discussed recently in other contexts: 
Farago [20] was the first, to the best of our knowledge, to show with exact results the 
difference of the large deviations of work done by the thermostat and energy dissipated 
by the system, in stochastic models described by a Langevin equation. Border terms had 
been dealt with also in deterministic dynamics, in the paper j2I] by Evans and Searles, 
where the "dissipation function" /, analogous to our W, was introduced as a physically 
relevant quantity. In a time dependent Langevin equation, van Zon and Cohen |22] 
and more recently Baiesi and co-workers have studied the difference between work 
done and heat transferred to the thermostat; the effect of a border term making the 
difference between two heat fluxes in a non-equilibrium Langevin model has been studied 
with exact analytical results in a more recent paper by Visco Simulations of 

deterministic system have revealed the importance of border terms also at finite 
times. In Ref. jSE] the necessity of the inclusion of border terms was recognized, and the 
example of a Bernoulli process has been discussed. In the Lebowitz-Spohn formulation, 
the problem of borders at finite times has been treated in [22], considering simulations 
of a tracer particle in a granular gas. The necessity of including border terms has also 
been recognized in j28j . 

The term B can contribute to the large deviations of W, even if all time-rescaled 
cumulants of its fiuctutations vanish. Van Zon and Cohen [22] first made a general 
observation: if one has a time-extensive variable Y{t) (an observable whose cumulants 
all grow linearly in time §) and a non extensive variable X with unbounded fluctuations 

§ We informally use the term extensive, referring to the "time-Gibbsian property" (see for example |17| 'l 
of the measure of V{il) and therefore of prob(VK = X): this amounts to say that the probability of 
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whose probability has exponential tails, or slower, then there is no guarantee that the 
extensive variable Z{t) = X + Y{t) has the same large deviations of Y{t). Heuristically, 
this observation may descend from the existence and finiteness of the large deviation 
function for X, 

n{x) = lim - logprob(X G ((x - S)t, {x + S)t) . (7) 

t^oo t 

On practical grounds, we will show that the "memory" of initial and final conditions, 
i.e. the relevance of B, lasts much longer (10'^ times longer and more) than the typical 
time defined in terms of the probability evolution of the Markov process toward the 
invariant probability, making the FR for W practically impossible to verify in almost 
all our examples. Recent theoretical studies j2S] predict that the form of the violation 
of the FR for W should have given character in general, so that the resulting FR would 
take the form of the heat FR of Van Zon and Cohen. These studies concern a given 
class of systems and observables, hence it is interesting to see which other systems verify 
the same predictions and which systems do not. For instance, Ref. [22] shows models in 
which the violation of the FR takes on a different form. Therefore, we investigate also 
this question. 

In section II we will pose the problem in a general form. Our two stochastic 
examples, a Markov chain with a large number of states and a continuous time Markov 
process exactly defined by the dynamics of a tracer in a granular gas |2ZI, will be 
discussed respectively in Section III and IV. Concluding remarks will be given in section 
V. 



2. Action functionals in Markov chains 

2.1. Definitions and properties 

Consider a Markov chain with (possibily infinite) states with invariant probability 
measure /x and transition rates Kab which denote the conditional probability of going 
from state a to state b, we are interested in the fluctuations of the following two "action 
functionals" : 

mr)=X:iog^^ (8) 

W'{t)= j2\og^^p^ + log (9) 

where ai G {1,2,...A^} is the state of the system at time i. Both functionals have 
been defined by Lebowitz and Spohn, in [12], who focused on the properties of W 
neglecting the importance of the difference B = W — W . For this reason, we call 
W as the "Lebowitz-Spohn functional", while we refer to W as to the "corrected" or 

W obeys a large deviation scaling, being time the "large parameter" , or in other words that it is 
characterized by an exponential decay when the time length of the trajectory is linearly increased. 
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"adjusted" functional. Both W and W associate a real number to any finite trajectory 
(any realization of the Markov chain), and have the following properties: 

• Zero at Equilibrium: by equilibrium we mean a stationary state which verifies 
the detailed balance condition HaKab = fJ^bKba, being /x = {/Xj} the invariant 
measure. Then, one has W(t) = if Kat = K^a, even during transient states 
represented by measures other than the microcanical one. However, W{t) ^ even 
at equilibrium except for isolated (microcanonical) systems. Differently, W'{t) = 
at any equilibrium state, but not in transient states. 

• Ergodicity: for t large enough, for almost all the trajectories lims-^^oo W (s) / s = 
lim^^oo W'{s)/s = {W{t)/t) = {W'{t)/t); here (assuming an ergodic and stationary 
system) () indicates an average over many independent segments from a single very 
long trajectory. 

• Entropy production: Let S{t) = — YliLi log be the entropy of the system at 
time t, where Vi{t) is the probability to be in the state i at time t; then 

Sit + 1) - S(t) = R{t) - A{t) (10) 

where R{t) is always non- negative, A{t) is a linear function with respect to 
u{t) = {i^i{t)}, and {W{t)) = {W'{t)) = Jl^dt'A{t'). In ^ this has been shown 
for continuous time Markov processes, but the proof is valid also in the discrete 
time case (see for example [HU]). This leads to consider W(t) and W'(t) equivalent 
to the contribution of a single trajectory to the total entropy flux. In a stationary 
state A{t) = R{t) and therefore the flux is equivalent to the production. 

• Positivity of the average: for large enough t: 1) at equilibrium (i.e. when there 
is detailed balance) {W(t)) = {W(t)) = 0; 2) out of equilibrium those two averages 
are positive. 

Let us now introduce our objects of study: 

• FRw- 7r{w) — n(—w) = w where 7r(w) = hmt^oo j log /(t, tti') and f{t,x) is the 
probability of finding W{t) = x at time t. Note that, in principle n(t,w) = 
jlog/(t,tw) 7^ Tiiw) at any finite time; a derivation of this property has been 
obtained in while a rigorous proof with more restrictive hypothesis is in jl7j : 
the discussion for the case of a Langevin equation is in |18|. 

• FRw'-. W{t,w) - W{t,-w) = w where U'{t,w) = \ log f'{t,tw) and /'(t,x) is the 
probability density function of finding W'{t) = x at time t. 

2.2. Fluctuations of W 

We first define an extended probability vector p{t, W) where each component pi{t, W) 
is the probability of finding the system at time t in the state i with the value W for 
the Lebowitz and Spohn functional. This means that ^jPj(t, VT) = f{t,W) is the 
probability density function at time t for the functional W, while / dWpi{t, W) = uiit) 
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is the probability of finding the system in state i at time t and J dW pi(t, W) — 1. We 
will use the simple notation /ij to denote the invariant measure, i.e. /li — \imt-^^ i/ilt) . 
The evolution of p{t, W) is given by the following equation: 

Pi{t + 1,W) = J2 KjiPj{t. W - /^Wji) (11) 

3 

where K is the previously defined transition matrix and Aty^j is the variation of W due 
to a jump from the state i to the state ?'. This reads Awj,- = In for the original 
Lebowitz-Spohn functional. 

Then define the function p{t,X) — J dW exp{—XW)p{t,W) and obtain, for its 
evolution 

p,{t + 1, A) = ^ Kj,pj{t, A)e-^^--. (12) 

j 

In a compact form we can write 

p{t+l,X)^A{X)p{t,X) (13) 
A{X) being the matrix defined by 

A,(A) = Kjr^K>;, (14) 
and, therefore, 

p(t,A) = A(A)*p(0,A) (15) 

with Pi(0,A) = / dW exp{-XW)iyi{0)S{W) = u,{0). 

Note that the ij-term of the evolution matrix fij{t, A) = [A(A)*]jj is a function of A 
that represents the characteristic function of the distribution of W at time t constrained 
by the conditions o"i = j and at = i (i.e. the system is in state j at time and in state 
i at time t). In turn, the characteristic function of the distribution of W is obtained 
summing over all the states: 

i i j 3 i 

In principle (under suitable analiticity assumptions) one recovers the distribution 
of W at time t by inverting the transform: 

/+ioo ^ 
dAexp(AVF)/>,A). (17) 
-ioo 

The knowledge of the characteristic function suffices to generate the moments or the 
cumulants of W: 



d'^ ~ 



(18) 

c = {-IT ^\og fit A) . (19) 

A=0 



A=0 
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2.2.1. The large time behavior and the FRy/ At large times, the evolution operator 
A{\y is dominated by the largest eigenvalue yi{X) of A{\). Defining yi{\) = exp(^(A)) 
it follows that 



p(t,A) 



exp(C(A)t) 



/(t,A) = 5^p,(t,A)~ exp(C(A)t) 



■ j 



x«(A) 



(20) 



where x(^)(A) is the eigenvector of A(X) associated to the largest eigenvalue yi{\)- One 
expects, from the above large times behavior, an analogous large time behavior for the 
density distribution of W, i.e. 



p+ioo 

f{t,W) = I dAexp(Aiy)5^z/,(0)5^[A(A)*],, 
~ exp 

where we have defined 7t{w) = \imt-,oo j^og f(t,wt), the large deviation function 
associated with f{t,W), which (under the validity of the last chain of equalities) is 
obtained as a Legendre transform of C('^)) i-e- vr(ty) = X*w + C('^*) with ^^(A)|a=a* = 
—w. 

The FR\Y symmetry appears at this stage. In fact, it is evident that A{X) = 
A^^l — A) being A'^ the transposed of A. This implies that C(A) = C(l ~ which 
suffices to get tt^w) = tt{—w) + w, i.e. f(t, W) = f{t, —W) exp{W) at large times. 

Clearly the validity of the expansion in ()22|) is crucial for the validity of the FRy/ 
symmetry, but it is not guaranteed when the integrand presents non-analiticities in the A 
complex plane. Such a catastrophe can happen, for example, when the number of states 
N becomes infinite and the initial (final) probability /ij(j)(0) has some unbounded form 
(see below). The physical meaning of such a catastrophe is that the large fiuctuations 
in the initial and final state cannot be neglected, because they contribute to the tails 
(i.e. the large deviations) of /(t, W) at any time and, therefore, they prevent the FRw 
symmetry. 

The problem, now, is to find a condition sufficient to trigger the analyticity 
breaking, in terms of initial/final state distribution. Note that the breaking of analiticity 
of /(if:. A) is associated with large fiuctuations of invariant probabilities, but here "large" 
has a very generic meaning and does not require the presence of any power law 
tail. Apparently (from many studies including numerical simulations [2Z|, analytical 
calculations [201 and heuristic arguments, cf. for example j22j), the initial and 
final configurations can be a problem when the distribution of the boundary term 
-B = In /io-(o) ~ In /^cr(t) has exponential, or higher, tails in the stationary state. But 
the problem may occur even if /ij has Gaussian tailsl 



W 

tmax I A h C{X) 

X \ i 



exp[t7T{W/t)] 



(22) 
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2.2.2. The second functional and the finite time symmetry relation Let us see what 
happens to the "adjusted" functional W. Here the prime will always denote quantities 
which involve this second functional. For example we have the extended measure vector 
p'(t,W') and the probability density function at time t, f'(t,W'), the characteristic 
function f'{t,X), etc. The increment for the functional at each jump reads Aty^'^ = 

Awij log (^^^ 5 recalling that /Xj is the invariant measure for the state i. The evolution 
matrix therefore reads 

4(A)=irj-^ir^./i7V, (23) 

and the evolution equation reads 

p'(t + l,A)=A'(A)p'(t,A). (24) 

The fundamental difference between W and the original W function appears now. Since 
p'(0, A) = 1^(0), if one takes 1^(0) = /x (the system is in the stationary regime from the 
beginning), it happens that 

/'(I, A) = $^;5:(i,A) = EE^^.(^)/^^- = EE^lr'^^-^^-V, (25) 

i i j i j 

i.e. /'(I, A) = /'(1, 1 — A). By recursivity, one realizes that this is the case for all times 
t, i.e. 

/UA) = /U1-A), (26) 
in general, which leads immediately to a finite-time symmetry relation 

f'{t,W') = f{t,-W')exp{W'), (27) 
valid for any t. 

The second functional contains a term that absorbs all the effects of the fluctuations 
of the steady state measure, leading to a conservation of the symmetry A — 1 — A all 
along the evolution. Such a conservation prevents bad surprises at large times also in 
presence of large fluctuations of the initial measure. 

2.2.3. Characteristic times When discussing the asymptotic validity of a fluctuation 
relation in a finite time simulation an immediate question arises: what are the 
characteristic times of the evolution and how large with respect to them is the chosen 
time r? The correct answer, here, is that one is really probing the asymptotic behavior, 
i.e. really measuring the large deviations of functionals W and W , if and only if the 
fluctuations satisfy the following time scaling: 

/(t,iy) ~exp[t7r(iy/t)]. (28) 

Actually, this is equivalent to observe stationary values for the time-dependent 
cumulants rescaled with the time c„(t) = {W{tY)c/t and c^(t) = {W'{tY)c/t. Verifying 
the stationarity of the rescaled cumulants sometimes proves to be advantageous with 
respect to the scaling ()28p : a cumulant is in fact a simple number containing information 
on /(t, W) in an integrated form. On the other hand, the stationarity of a cumulant is a 
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necessary but not sufficient condition for the validity of the scahng (all cumulants 
must be stationary) and its measure may eventually be very noisy. 

The large time dominance of the maximum eigenvalue allows the direct calculation 
of the asymptotic cumulants of W and W, i.e. 



c„(oo) = }}^{Wnc/t = {-ir ^C(A) 
<(oo) = lim{{Wr)c/t = i-ir :jtzCW 



(29) 

A=0 

(30) 

A=0 



dX' 

These formulae are valid provided that ({X) and C'(-^) analytic in zero. Numerical 
observations in the following example suggest a coincidence between c„(cxd) and c^(cxd). 
This is consistent with direct calculations of ({X) and which appear to coincide, 

in Markov chains with a small number of states. We have not been able to address 
analytically the case of a Markov chain with an infinite number of states. The other 
evidence which will appear from the simulations (already noticed in the granular tracer 
model |2Z|) is that the cumulants of W are much slower than those of W to converge 
to a stationary value. 

The time of convergence to the perfect large deviation scaling (j28|l is determined in a 
complex manner by the other eigenvalues (from the second one) of the operator A[X) (or 
A'{X)). It will be interesting to compare this convergence time (estimated for example 
from the convergence time of the rescaled cumulants) with the characteristic time of 
the Markov chain itself tm- We will use, for tm, the time obtained with the following 
standard recipe. An initial vector 1^(0) evolves under the action of the transpose of the 
transition matrix: 

^(t) = (K^YuiO). (31) 

For a generic i/(0) one has iy{t) = fi + 0(e^*/'^'*^) where the characteristic time tm is 
given by the second eigenvalue a2 of K^, i.e. the closest one to the unitary circle: 

= II } M - (32) 
I ln(a2)| 

One can easily compute tm from the area a(t) of the parallelogram identified by ^t and 
^(t): 

a(t) ~ exp(-t/rM). (33) 



3. A Markov chain 



We discuss a simple Markov chain which does not correspond to any particular physical 
system, but turns out to be useful in illustrating the relevance of the boundary term B 
in the fluctuations of the two action functionals. Such a model has been inspired by a 
work by Gaspard and Wang jHT] . 
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3.1. The model 

We consider a Markov chain with states, labelled A, B and Q with i G {1, 2, ...iV}. 
The transition matrix K is given by 



/ PAA 


Pas 


(1 


-PAA -PAB)ki 


(1 


-PAA-PAB)k2 ■ 


■ (1 


-PAA -PAB)kN \ 


Pba 





(1 


-PBA)ki 


(1 


-PBA)k2 


• (1 


-PBA)kN 


PCA 


1 -PCA 












. 




PCA 


1 -PCA 












. 





with YliLi ki = 1, under the constraint that for every jump with nonzero transition 
probability, the reversed jump is also possible. The invariant probability /x for = 1 
is given by 

Pba+Pca- PbaPca 
= (35) 

I - PAA + PCAiPAB + PAA - I) 

f^B = (36) 

1 - PAA - PABPbA 

= jj= (37) 

with J\f =2 + paa{-2 + pca) + PabPca - Pba{-1 + Pab + Pca)- 

It can be easily seen that the invariant measure for > 1 is the same as in the 
case = 1 with a decomposition of the measure of state Ci into the measures of Ci 
proportional to the values ki. 

yWc. = ^^cki (38) 



3.2. Numerical results 

3.2.1. Fluctuations of the functionals We measure the functionals W{t) and W'{t) 
along independent non-overlapping segments of time-length r extracted from a unique 
trajectory after the stationary regime has been achieved. In particular we probe the 
validity of a relation like 

Gr{X) = log F{t,X) - logF(r, -X) = X (39) 

where F{t,X) is the probability density function of finding one of the two functionals 
W or W after a time t equal to X (i.e. F{t,X) corresponds to f{t, W) or to f'{t, W) 
depending on the cases). All the results are shown in figures Q and El containing the 
graph of Gr vs x and the pdfs of W and W, with different choices of the transition 
probabilities and of the time r. We separately discuss three main cases of interest. 

1) Whenever A is disconnected from all Cj's, i.e. when pab = 1 —Paa and pcA = 0, 
detailed balance is satisfied. The numerical results confirm what is expected: in the 
detailed balance (equilibrium) case, W'{t) is identically zero and does not fluctuate (its 
pdf is a delta in zero) and therefore W{t) coincides with the opposite of the boundary 
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term B = log they both have symmetric fluctuations around zero with exponential 
tails, and Gr = 0. 

2) Lines 1-3 of figureEl Whenever A is connected to all C^'s, i.e. when pab < ^—PAA 
and pcA > 0, detailed balance is violated. In this case both W{t) and W'{t) fluctuate 
around a nonzero (positive) value which, for r large enough, is the same for the two 
functions. We have chosen = 50, paa = 0.2, pab = 0.3, pba = 0.3, pcA = 0.5, 
r = 100. In the first line of graphs of figure |2l we have fcj oc exp{—i'^/10), while in 
all the other frames ki oc exp{—ai) with different a. The choice of the transition rates 
ki from state B to state Cj determines the invariant measure of states Cj, which is 
still proportional to ki. Note however that, even in the Gaussian case, the fluctuations 
of the boundary term B = log have a pdf with exponential tails, as confirmed by 
the numerical observation. The other relevant observation, here, is that the pdf of 
W is almost perfectly Gaussian. This is not true for the pdf of W. At small times 
(r = 100) the pdf of W resembles the pdf of B, evidencing that at this time W is 
completely dominated by B. At larger times the pdf of W and B start to deviate, in 
particular that of W tends to become equal to that of W, still with evidently different 
tails of exponential form. The tails of the pdf of W seem to be always dominated by 
the fluctuations of B. Note that (in the third and fourth line of the figure) when the 
invariant measure is peaked on the first states (i.e. when a is high) the fluctuations of 
B have the form of a sum of peaks and the pdf ofW = —B + W has the form of a sum 
of Gaussians centered on those peaks. 

The symmetry relation for the functional W is not verified in any of these 
simulations, both at small and large times. The asymmetry measure Gt-{W) has a slope 
near 1 only for small values of -C (W), then deviates and saturates to a constant 
value in good agreement with the value 2{W) predicted by van Zon and Cohen |22j . 
also in agreement with ref. [2B|. Note that the observations at large times are perfectly 
compatible with those at small times, i.e. if both ordinates and abscisass are divided 
by r the curves are similar (in the first two cases they collapse very well). Therefore 
the "reduction" of the violation at large times is only apparent. On the other hand the 
symmetry relation for W is always satisfied, at all times and for all the choices of the 
parameters. 

3) Fourth line of figure |21 In this simulation the invariant measure on states Ci is 
still an exponential, but with a higher slope. In this case our numerical results show 
that the fluctuations of W are much closer to those of W already at small times. This 
is reflected on the good agreement with the Fluctuation Relation of both functionals 
W and W. Note that one can still be doubtful about this verification, because of the 
limited range of values of W available, which can possibly hide a failure at larger values. 
The distribution of the boundary term in fact still has exponential tails (invisible at our 
resolution) and again it can be argued that these tails (being Gaussian those of W) will 
dominate at very large values. 
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Figure 1. Color online. Probabilities of observing W (black squares), W (red 
circles) and B — W' — W (green lines), for the Markov chain. Each line is composed 
of two graphs and shows the results for a particular choice of the parameters: the 
left column is at time r = 100 and the right column at time r = 1000. In all 
the simulations we have used N = 50. In all frames we have used paa = 0.2, 
PAB = 0.3, pba = 0.3 and pcA — 0.5: the first line corresponds to Gaussian tails of 
the invariant measure, because ki oc ea;p(— i^/10), while the last three lines correspond 
to exponential choices ki cx exp{—ai) with the value of a given in the plot. In all cases 
{W{t)) = {W'{t)) = 0.0053r, i.e. 0.53 for t = 100 and 5.3 for r = 1000. 
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Figure 2. Color online. Gr(W) vs. W (black squares) and Gt{W') vs. W 
(red circles) for the Markov chain. Each line is composed of two graphs and shows 
the results for a particular choice of the parameters: the left column is at time 
r = 100 and the right column at time r — 1000. The dashed line has slope 1. In 
all the simulations we have used N = 50. In all frames we have used paa — 0.2, 
PAB — 0.3, pba — 0.3 and pcA — 0.5: the first line corresponds to Gaussian tails of 
the invariant measure, because ki oc exp{—P/lO), while the last three lines correspond 
to exponential choices ki oc exp{—ai) with the value of a given in the plot. In all 
cases {W{t)) = {W'{t)) = 0.0053t, i.e. 0.53 for t 100 and 5.3 for r = 1000. The 
dotted horizontal line marks the van Zon and Cohen prediction for the FR violation, 
Gr{W) = 2{W) for large W |221- 
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3.2.2. Characteristic times: scaling and cumulants Following the recipe given in 
section 121221 we have calculated the characteristic time tm associated with the approach 
toward the invariant probability of the Markov chain. Our general observation is that 
its dependence upon the choice of the particular form of the transition probabilities ki, 
which couple the state B with the N states Cj, is negligible. In particular, for all the 
choice of parameters corresponding to the cases shown in figure El we have measured 
Tm ~ 2.1, while in the equilibrium case paa = 0.2, pab = 0.8, pba = 0.3 and pcA = 0, 
we have measured tm ~ 18. 

In figure Ol-left we plot the large deviation rate function at finite times 11 (t, x) for 
the two functionals W and W , in a non-equilibrium case with a choice of fcj such that 
the fluctuations of the invariant measure are large, i.e. fcj oc exp(— z) (the a = 1 case 
discussed in the previous section). The range of available values drops very rapidly as 
t increases, and, most importantly, the negative range tends rapidly to disappear. On 
the basis of these results one can conclude that the scaling (PHj) is already reached at 
t = 100. This is true for both functionals, W and W. The two large deviation rate 
functions appear different for W and W, they seem to have linear and quadratic tails 
respectively. 

In figure 01-right we show the values of the first four cumulants (divided by the 
time, i.e. c„(t) and cj^(t) as defined previously) of W(t) and W'{t), as a function of time 
t. The absolute values have been taken, in order to use a logarithmic plot and better 
appreciate the different orders of magnitude. In each frame of the figure the value of 
c^(lOOO) is given. One first observes that the cumulants of W become time-independent 
almost immediately. The values of the third and fourth cumulant are consistent with 
the previous observation that the fluctuations of W are almost Gaussian, and its large 
deviation rate function is quadratic. The remarkable fact is that the cumulants of W are 
much slower to converge to a stationary value: as a matter of fact we cannot conclude, in 
our case, that this convergence has been actually reached apart from the first cumulant. 
The measure of the cumulants points out the weakness of a naked-eye verification of the 
large deviation scaling as the one obtained in figure 01- left. 

4. The granular tracer 

Recently, both in experiments jHSj and in simulations , the validity of the FRw has 
been studied in granular gases. A granular gas consists of inelastic particles, typically one 
has a box containing macroscopic grains (like sand) strongly vibrated in order to obtain 
a dilute and fluidized stationary regime, which is far from equilibrium because of non- 
conservative forces acting on and among the grains. In a series of other papers jHl] it has 
been shown that the prototypical model of granular gas, the gas of inelastic hard spheres, 
cannot be used without some care as a benchmark for the validity of the fluctuation 
relation: each single collision violates time reversibility, so that for any trajectory in 
the phase space of the whole system, its reversed trajectory does not exist. This implies 
that the large deviations of entropic functionals are deflned only for positive valuess, and 
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Figure 3. Color online. Left: the large deviation function rate at finite times 
n(r, x) — n(r, 0) = — ;^ log pl^'gj for the fluctuations of W/t (top frame) and of W /t 
(bottom frame). The dashed line shows the quadratic function associated with the 
Gaussian of same mean and same asymptotic variance, while the dotted line marks 
0. Right: the first four time-rescaled cumulants of W (squares) and W (circles) as a 
function of time. The solid green line represents the absolute value of the cumulant of 
W' /t at t = 1000: this value is also indicated in each frame. The parameters are the 
same as in figure ^ second line (i.e. ki ex. exp —i). 



that the fluctuation relation cannot be verified. However, focussing on the Markovian 
dynamics of a single tracer particle immersed in a gas, one may circumvent the problem 
of strong irreversibility and probe the validity of the FR in granular gases [22] . 



4.1. The model 

We consider the dynamics of a tracer granular particle in a homogeneous and dilute gas of 
grains which is driven by an unspecified energy source. The tracer particle experiences 
consecutive collisions with particles of the gas coming from the same "population", 
independently of the position and time of collision. The gas is characterized by its 
velocity probability density function -P(v), which is well known to be mildly non- 
Gaussian and well reproduced by a first Sonine correction jSH]. The dilution of the gas 
guarantees that the transient as well as the stationary regimes of the velocity probability 
density function -P*(v) of the tracer is governed by a Linear Boltzmann equation. 

The inelastic collisions with the gas particles, which determine the instantaneous 
changes of the velocity of the tracer, are described by the simplest and most used 
inelastic collision rule: 

v' = v-m^±^[(v-V).cl,]a; (40) 
m + M 

where v and v' are the velocities of the tracer before and after the collision respectively, 
V is the velocity of the gas particle, m and M are the masses of the tracer and of the 
gas particle respectively, a> is the unitary vector joining the centers of the two particles, 
and a is the restitution coefficient that takes values in [0, 1] (1 is the elastic case). For 
simplicity, in the rest of the discussion we will consider 2-dimensional systems with 
m = M (see j^Zj for a more general discussion). 
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The analysis of the Linear Boltzmann equation leads to the following Master 
equation for the evolution of the velocity probability density function of the tracer: 

^^^^^ = I dvi[P.(vi)ir(vi,v)-P.(v)ir(v,vO]. (41) 

where P*(t') is the velocity pdf of the test particle. The transition rate K(y, v') (see ^Ij 
for a precise definition) of jumping from v to v' is given by the following formula: 

^(V,V') = (y^) j dV2rP[M^,V,V2r)], (42) 

where Av = v' — v denotes the change of velocity of the test particle after a collision 
and P(v) is the velocity pdf of the gas. In Eq. ()42j) it has been assumed that the mean 
free path equals 1, which can be always obtained rescaling the time. This means that 
the elastic mean free time is rf = l/2^/7i (it is larger in inelastic cases). The vectorial 
function V2 is defined as 

V2(V, V', V2r) = V2a{'V, v')(t(v, v') + V2rr, (43) 

where 6-(v,v') is the unitary vector parallel to Av while r is the unitary vector 
perpendicular to it. Finally, to fully determine the transition rate (jl21), the expression 
of V2a is needed: 

2 

V2a{v, v') = — — I Av| + V ■ 6- . (44) 
1 + a 

For the purpose of measuring the fluctuations of the functional defined by Eq. (jH}, 
Eq. ^ yields: 

K{^r,V) ^ Jdv2rPM^,y^',V2r)] _ PK(v,vO] . . 

ir(v',v) JdV2rP[M^',^,V2r)] PK(v',v)] ' ^ ^ 

Then we consider two possible choices for the velocity pdf of the gas, a Gaussian and a 
non-Gaussian case expressed in the form of a first Sonine correction to the Gaussian jSSj, 
which amounts to P(v) = ^-^P (~^) (l+'^25'|(t'^/2T)). The first Sonine correction 
enters by means of the small parameter 02 (which is in the Gaussian case) and the 
Sonine Polynomial 5*2(0;) = — + f^I^^t^^ which depends upon the choice of 
physical parameters, e.g. density, restitution coefficient, etc. The most realistic case is 
the non-Gaussian one, which is common to all experiments and simulations, while the 
Gaussian case is presented for reference (after the study of Martin and Piasecki ^Tj). 
In the Gaussian case we get 

, K(v,V) A l-aA3-aA 

Ki^) = 2T + 'TT^ 2T = TT^ 2T' ^^'^ 

with A = v^ — {v'^y = \v\^ — |f 'P, i.e. the kinetic energy lost by the test-particle during 
one collision. In the First Sonine correction case it is instead obtained 



, K(v, v') 3 - « A , 
A(v, v) 1 + a 2i 



|l + a2^2^=i 




] 


2T 




|l + 02^1=1 




1 


2T 





(47) 
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In the case where P{v) is a Gaussian with temperature T, it is immediate to observe 

that 

P,(v)ir(v, v') = P,{v')K{v', v) (48) 

if P^, is equal to a Gaussian with temperature T' = fz^T < T. This means that there 
is a Gaussian stationary solution of equation (j^T| (in the Gaussian-bulk case), which 
satisfies detailed balance. The fact that such a Gaussian with a different temperature 
T' is an exact stationary solution was known from [37]. It thus turns out that detailed 
balance is satisfied in these cases, even in the absence of thermal equilibrium. Of course 
this is an artifact of our model: it is indeed highly unrealistic that a granular gas yields 
a Gaussian velocity pdf. As soon as the gas velocity pdf P{v) ceases to be Gaussian, 
detailed balance is violated, i.e. the stationary process performed by the tracer particle 
is no more in equilibrium within the thermostatting gas. 

4.2. Numerical results 

The dynamics of a tracer particle undergoing inelastic collisions with a gas of particles 
in a stationary state with a given velocity pdf -P(v) has been simulated by means of 
the Direct Simulation Monte Carlo algorithm [HH]- We have three parameters: the 
restitution coefficient a of collisions between the tracer and the rest of the gas, the 
temperature of the gas T (which we take as unity) and the coefficient of the first Sonine 
correction which parametrizes the velocity pdf of the gas, 02. The tracer particle has 
a measured "temperature" (mean kinetic energy) < T and a velocity pdf that 
is observed to be well described again by a first Sonine correction to a Gaussian, 
parametrized by a coefficient a^. To measure the quantity W'{t) = W{t) + B on 
each segment of trajectory we assume this observation to be exact and we use the 
values and measured during the simulation itself to compute the "boundary term" 
B. All the results are shown in figures |3] and for two different choices of the time 
T and many choices of the parameters a and 02. We display in each figure the value 
of (w) = lim^^oo W^(''")/t. Again the idea that this quantity measures the distance 
from equilibrium of our system is well supported by the results of the simulations: (w) 
is zero when 02 = and increases as a is decreased and 02 is increased. We recall 
that lim,-^oo W^(t)/t = limr-,00 W{t)/t = {w), since the difference between the two 
functionals has zero average at large times r. We also remark that the distribution of 
both quantities W and W are symmetric at equilibrium (i.e. when 02 = 0). 

We first discuss the results concerning the fiuctuations of W{t), identified in 
figures m and |31 by squared symbols. They are strongly non-Gaussian, with almost 
exponential tails, at low values of r for any choice of the parameters. At large values 
of r (many hundreds of mean free times), the situation changes with how far from 
equilibrium the system is. At low values of (w) the tails of the distribution are very 
similar to the ones observed at small times. At higher values of (w) the distribution 
changes with time and tends to become more and more Gaussian. We have not been able 
to measure negative deviations larger than the ones shown in the figures. Distributions 
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obtained at higher values of r yielded a smaller statistics and very few negative events. 
With these numerical observations, we could not verify the FRy/ relation. In the last 
case, which is very far from equilibrium (02 = 0.3, a = 0), a behavior compatible with 
FRw is observed, i.e. GriW) ~ W , but the range of available values of W is much less 
than {W). At this stage, and in practice, we consider such results a failure of the FRw 
for continuous Markov processes. Our numerical results are also in fair agreement with 
the prediction by van Zon and Cohen for the violation of the FRw, i.e. (at least for 
large times and not too far from equilibrium) Gr{W) ~ 2{W). The deviations from the 
Gaussian of the pdfs of W are weaker than those observed for W, and the FR^i is 
well satisfied in all non-equilibrium cases at all times r. The verification of both FRs is 
either trivial or meaningless in the equilibrium cases (02 = 0), where = 0. 

5. Conclusions 

We conclude this paper with the following observations. In the first place, it seems 
important to point out the remarkable similarity of the results obtained for a rather 
abstract Markov chain and the granular tracer. Because the observables considered in 
this paper are subtle, one may expect that the similarity between the abstract and the 
concrete models concerns other observables as well, which is worth further investigation. 

We have observed a failure of the fluctuation relation for W (FRyy), at all times 
that we could consider. This does not exclude that the relation holds at much larger 
times, which are of no practical interest, although they can be of theoretical interest. 
The failure is due to the boundary terms, which become more and more important as 
the steady state draws closer and closer to equilibrium. This suggests that the difference 
between physically relevant times, and the times at which the FRw might be verified, 
grows as the steady state approaches an equilibrium state, possibly diverging in the 
equilibrium limit. 

The (practical) failure of the FRw reported here does agree in a quantitative fashion 
with the one predicted by Van Zon and Cohen, which was thought to be at work also 
in some deterministic systems j2E]- However, a different conclusion is afforded by the 
results of [22] , which indicates that the possible failures of the FRw do not have a 
universal character, and that further investigations are desirable. 

The general conclusion that we can draw from the above observations is that large 
deviations are particularly subtle objects, whose peculiarities are not so obvious in the 
physics of equilibrium systems, but become evident as soon as a slight perturbation 
away from equilibrium sets in. This should not sound paradoxical: steady states are 
achieved asymptotically in time; this allows phenomena, such as long range correlations, 
which are extraneous to the physics of most equilibrium systems, but are well known 
in the physics of nonequilibrium steady states. Furthemore, to keep a system on a 
nonequilibrium steady state, an unlimited amount of work may be done on the system 
or extracted from it, and this is bound to have observable (and perhaps exploitable) 
consequences on the behaviour of the system. 
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Figure 4. Color online. Probability of fluctuations of W{t) (black squares), W'{t) 
(red circles) and B — W' — W (green line) for the continuous Markov process defined 
by the dynamics of a tracer in a granular gas. Each line is composed of two graphs and 
shows the results for a particular choice of a and 02 (the coefficient of the first Sonine 
correction characterizing the non-Gaussianity of the velocity pdf of the gas): the left 
graphs are at small times, while the right graphs are at large times. Mean free time 
between collisions slightly varies with parameters, but is always near Tc ^ 0.3. For 
each choice of parameters, inside the right graph, it is shown the value of {W{t)) and 
of (w) EE {W{t))/t = {W'{t))/t EE lim^_,oo W{t)/t = lim^^oo W'{t)/t which can be 
considered a distance from equilibrium. 
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Figure 5. Color online. Gt{W) vs. W (black squares) and Gr{W') vs. W (red 
circles) for the continuous Markov process defined by the dynamics of a tracer in a 
granular gas. Each line is composed of two graphs and shows the results for a particular 
choice of a and 02 (the coefficient of the first Sonine correction characterizing the non- 
Gaussianity of the velocity pdf of the gas): the left graphs is at small times and the 
right graphs at large times. For each choice of parameters, inside the right graph, it is 
shown the value of {W{t)) and of (w) = (VF(r))/T = (M^'(T))/r = lim^^^o W^(T)/r = 
limT-^oo W'{t)/t which can be considered a distance from equilibrium. The dashed 
line has slope 1. The dotted line represents the van Zon and Cohen prediction for the 
FRw violation, Gr{W) = 2{W) for large W It is not visible in the fourth hue. 
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